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INTRODUCTION 


Under  contract  to  the  Army's  Night  Vision  and  Electro-Optics  Laboratory, 
Westinghouse  has  been  investigating  the  design,  test,  and  implementation  of  a 
set  of  algorithms  to  perform  intelligent  tracking  and  intelligent  target  homing 
on  FLIR  and  TV  imagery.  Research  has  been  initiated  for  the  development  of 
an  intelligent  target  tracking  and  homing  system  which  will  combine  target 
cueing,  target  signature  prediction,  and  target  tracking  techniques  for  near 
zero  break  lock  performance.  The  intelligent  tracker  will  monitor  the  entire 
field  of  view,  detect  and  classify  targets,  perform  multiple  target  tracking, 
and  predict  changes  in  target  signature  prior  to  the  target's  entry  into  an 
obscuration.  The  intelligent  tracking  and  homing  system  will  also  perform 
target  prioritization  and  critical  aimpoint  selection.  Through  the  use  of 
VLSI/VHSI  techniques,  the  intelligent  tracker  (with  inherent  target  cuer)  can 
be  applied  to  the  fully  autonomous  munition. 

During  the  third  quarter,  several  meetings  and  a  number  of  phone 
conversations  took  place  between  Westinghouse  personnel  and  John  Dehne  and 
Capt.  Ben  Reischer  of  NV&EOL.  A  system  concept  was  developed  for  the  intelligent 
tracker.  A  comparison  was  conducted  between  several  frame- to- frame  tracker 
designs.  Work  on  the  875  frame  storage  was  completed.  Seven  scenarios  from  the 
NV&EOL  data  base  were  analyzed.  This  analysis,  in  conjunction  with  an  analysis 
of  the  intelligent  tracker  functions,  and  an  analysis  of  AAH,  RPV.  and  PGM 
scenarios  containing  an  intelligent  tracker  served  as  the  basis  for  the  system 
concept. 

Westinghouse  personnel  participating  in  this  effort  include  Thomas  Willett, 
Program  Manager,  Dr.  John  Romanski,  John  Shipley,  Leo  Kossa,  Tony  Cangialosi, 
Robert  Bidney,  and  Richard  Kroupa.  Program  review  and  consultation  is  provided 
by  Drs.  Glenn  Tisdale  and  Azriel  Rosenfeld. 
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1.0  SYSTEM  CONCEPT 

The  purpose  of  this  section  is  to  describe  the  preliminary  intelligent 
tracker  concept  that  has  evolved  from  analyzing  three  factors:  the  intelligent 
cracker  functions  (described  in  Section  1.1  of  the  Second  Quarterly  Report); 
the  application  of  the  intelligent  tracker  to  AAH,  RPV,  and  PGM  scenarios 
(described  in  Section  1.3  of  the  Second  Quarterly  Report);  and  seven  (7)  examples 
from  the  NV&EOL  data  base  (described  in  Section  4.0  of  this  report).  The  functions 
are: 

1)  acquisition  and  handoff  to  tracker  -  locate,  detect,  classify, 
and  prioritize  targets  automatically  and  handoff  to  a  tracker 
(the  intelligent  tracker  concept  is  assumed  to  include  both 
acquisition  and  tracking); 

2)  handle  multiple  targets  -  track  a  number  of  targets  in  a  scene 
simultaneously; 

3)  target  signature  prediction  -  predict  or  anticipate  target  occlusions 
and  how  the  target  signature  will  change  as  a  result  of  the 
obscuration; 

4)  reacquisition  -  reacquire  a  target  as  a  result  of  track  break 
lock  or  if  it  leaves  the  field  of  view; 

5)  aimpoint  selection  -  determine  the  critical  aimpoint  of  a  target, 
which  may  be  an  interior  point  within  its  silhouette. 

A  block  diagram  of  the  system  concept  is  shown  and  described  in  terms 
of  the  first  four  functions.  The  fifth  function,  aimpoint  selection,  will  be 
investigated  in  the  next  quarter. 


l.L  SYSTEM  BLOCK  DIAGRAM 
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Figure  1.0-1  System  Block  Diagram 


The  system  block  diagram  is  shown  in  Fiqure  1.0-1.  A  timinq  diagram 
is  shown  in  Figure  1.0-2.  The  horizontal  line  across  the  top  of  Figure  1.0-2 
represents  the  video  stream  seen  in  one  second  at  a  video  rate  of  30  frames 
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Figure  1.0-2  Timing  Diagram 

The  heavy  vertical  lines  represent  the  cued  frames  and  the  lighter 
vertical  lines  are  the  tracked  frames.  Note  that  there  are  30  vertical  lines 
in  total.  Frame  1  is  a  cueing  frame,  and  frames  2,3,4,  and  5  are  tracking  frames 

and  then  the  cycle  repeats.  Frame  6  is  a  cueing  frame,  and  frames  7,8,9,  and 
1J  are  tracking  frames.  The  bottom  of  Figure  1.0-2  represents  the  image  in  the 


frame  store  which  is  divided  into  five  horizontal  and  addressable  strips.  This 
is  done  so  that,  instead  of  waiting  for  the  entire  frame  to  be  cued  before  hand¬ 
over  to  tracker,  targets  can  be  handed  over  as  soon  as  they  are  cued.  The 
reduction  in  handover  lag  increases  confidence  that  both  cuer  and  tracker  are 
working  on  the  same  target,  and  reduces  the  size  of  the  track  window.  The 
frame  store  is  divided  into  five  addressable  strips  to  aid  in  sending  the 
gray  level  surrounding  the  target  to  the  tracker  for  a  reference  image.  The 
frame  storage  device  is  addressable  in  sections  to  increase  the  readout  speed. 

It  should  be  pointed  out  that  the  six  frames  per  second  and  five  strips  for 
frame  storage  are  approximate  numbers  serving  as  a  straw  man  concept.  The  point 
of  this  discussion  is  that  the  cuer  results,  labelled  CR,  in  Figure  1.0-2  can 
be  obtained  between  the  first  and  second  frames  instead  of  the  fifth  and  sixth 
frames  in  the  video  stream. 

Referring  to  Figure  1-1,  we  describe  the  handover  process.  A  horizontal 
strip  of  a  frame  is  snatched  in  real  time  and  placed  in  the  frame  store.  The 
cuer  processes  the  image  and  detects  and  classifies  a  target.  That  part  of  the 
frame  store  holding  the  target  and  its  surrounding  gray  scale  window,  assume 
12  x  12  pixels  for  a  9  x  9  pixel  target,  is  sent  to  the  tracker  as  a  reference 
image.  The  tracker  converts  this  to  a  binary  reference  image  and  now  tracks 
this  target  from  the  videostream  until  the  next  cued  frame.  The  cuer  tells  the 
tracker  where  the  target  is  within  the  frame  so  the  tracker  can  tell  the  write 
control  when  to  write  the  next  target  window  (now  from  the  video  stream)  and 
subsequent  windows  into  its  reference  image. 

For  multiple  target  tracking,  there  is  a  reference  image  device  for  each 
target,  but  the  tracker  is  fast  enough  to  be  multiplexed  among  the  targets.  The 
tracker  is  a  bandpass  binary  correlation  tracker  (Section  2.0)  in  this 
preliminary  design  and  the  bandpass  is  adjusted  at  the  cueing  rate  by 
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the  cuer.  Additionally,  the  tracker  forms  a  smoothed  track  for  each  target 
in  second  order  difference  equations  (to  interface  with  the  rate  loop  in  the 
sensor  gimbal).  This  allows  reacquisition  of  a  target  which  has  left  the  field 
of  view  but  can  be  brought  back  into  view  by  moving  the  sensor  along  the  image- 
centered  target  track. 

At  this  point,  one  can  imagi-  >  simultaneous  multitarget  cueing  and  tracking. 
The  cued  targets  have  been  classified  and  are  now  ordered  in  an  internal  table 
in  terms  of  priority.  The  priority  hierarchy  has  been  determined  before  the 
mission  and  loaded  in  the  cuer.  At  this  point  in  the  system  concept  description, 
we  have  discussed  the  system  block  diagram  in  terms  of  functions  1),  2),  and 
the  first  part  of  4).  The  next  topic  is  function  3)  -  target  signature 
prediction. 

To  predict  target  obscurations,  we  analyze  a  histogram  of  the  background 
ahead  of  the  target.  The  track  window  errors,  used  to  form  the  smoothed  track 
for  re-acquisition,  are  also  used  to  set  the  histogram  position.  Further,  the 
gray  level  reference  image  for  the  first  track  frame  after  a  cued  frame  is  also 
the  source  for  the  background  histogram.  From  the  histogram,  we  can  compare 
the  gray  levels  ahead  of  the  target  with  that  of  the  target.  If  the  same  gray 
levels  are  present  in  both,  a  clean  target  segmentation  is  unlikely.  The 
target  position  is  adjusted  within  the  track  reference  window  so  that  the  tracker 
is  using  that  portion  of  the  target  which  will  be  obscured  last  (in  the  case 
of  a  target  passing  behind  a  large  tree)  or  not  obscured  at  all  (in  the  case  of 
a  target  passing  behind  some  low  lying  shrubs).  The  background  histogram  is  also 
analyzed  for  a  polarity  change  between  the  target  and  the  background.  An 
example  of  this  is  a  case  where  a  light  target  against  a  dark  background  is  moving 
into  a  background  lighter  than  itself  and  hence  becomes  a  dark  target  against 
a  light  background.  Under  this  condition,  the  new  background  is  segmented  and 
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binary  change  detection  at  the  background  level  is  used  along  with  direct 
segmentation  to  detect  the  target.  Having  found  the  front  edge  of  the  target, 
the  tracker  is  switched  to  the  front  or  emerging  edge. 

Re-acquisition  resulting  from  track  break  lock  is  also  handled  by  the  cuer, 
histogram  analysis,  and  change  detection.  A  difficult  problem  here  is  the 
reappearance  of  a  target  which  is  partially  occluded.  This  prevents  segmentation 
of  the  entire  shape  so  that  one  is  forced  to  look  for  changes  in  the  scene.  The 
histogram  analysis  of  the  proposed  target  can  add  information  because,  in  some 
of  these  cases,  the  target  histogram  will  exhibit  a  peakedness  not  found  in  a 
background  object  such  as  a  woods  clearing.  Otherwise,  the  clearing  may  be 
mistaken  for  a  partially  occluded  target. 

Having  described  the  system  concept  in  terms  of  a  block  diagram  and  the 
intelligent  tracker  functions,  it  is  interesting  to  consider  the  synergism 
between  the  cuer,  tracker,  histogram  analysis,  and  change  detection.  From  a 
design  standpoint  there  is  a  large  amount  of  shared  hardware.  The  binary 
correlation  for  the  tracker  is  the  same  as  that  used  by  the  change  detection 
block.  The  histogram  function  forms  the  reference  window  for  the  tracker, 
forms  a  histogram  across  the  target  for  the  cuer,  and  forms  the  background  histogram 
in  the  histogram  analysis  block.  The  reference  frame  for  the  tracker  supplies 
gray  levels  for  the  background  histogram  analysis  block.  From  a  functional 
standpoint,  there  is  also  a  substantial  amount  of  synergism.  Although  we 
have  referred  to  the  tracker  as  a  simple  tracker,  it  is  not  really  that  simple. 

The  cuer  updates  the  tracker  bandpass,  and  the  histogram  analysis  block  looks  for 
potential  obscurations.  The  tracker  (with  these  aids)  begins  to  look  like  the 
sophisticated  tracker  that  we  mentioned  in  the  Second  Quarterly  Report.  Further, 
the  tracker  aids  in  pointing  out  target  positions  to  the  cuer  for  targets  cued 
in  previous  frames.  This  serves  as  a  source  of  confirmation  that  both  cuer 
and  tracker  are  working  on  the  same  target.  Finally,  in  a  re-acquisition  mode. 


the  cuer,  histogram  analysis  block,  change  detector,  and  tracker  work  together  to 
provide  confirming  information.  In  summary,  the  intelligent  tracker  concept 
has  the  potential  of  providing  a  substantial  improvement  in  performance  over 
any  of  its  components  operating  alone.  Further,  the  many  shared  functions  and 
hardware  offer  the  possibility  of  a  smaller  increase  in  hardware  volume  than 
anticipated. 


t 


2.0  FRAME-TO-FRAME  TRACKER 


In  the  second  quarterly  report.  Section  3.0,  we  described  the  baseline 
frame- to- frame  tracker  and  a  variation  called  a  bandpass  tracker.  In  this 
section,  we  present  a  comparison  between  the  two  based  on  an  example  from 
the  NV&EOL  TV  data  base. 


2.1  Tracker  Comparison 

The  xy  image  positions  of  the  target  are  shown  in  Figure  2-1  for 
successive  frames  245  through  251. 
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Figure  2-1.  xy  Target  Positions 
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The  frame- to- frame  tracker  is  a  binary  correlation  tracker  with  an  inner 
and  outer  window.  The  inner  window  is  initially  set  to  cover  at  least  90  percent 
of  the  target.  Successive  tracks  are  established  by  correlating  against  the 
contents  of  the  inner  window.  Section  3.0  of  the  Second  Quarterly  Report 
contains  a  detailed  discussion  of  the  tracker.  The  difference  between  the  baseline 
tracker  and  the  bandDass  tracker  is  that  in  the  latter,  a  range  of  gray  levels 
are  superposed  over  the  inner  window.  This  means  that  the  target  is  in  the  inner 
window  initially  and  also  within  a  certain  range  of  gray  levels.  For  the  comparison 
run,  the  inner  window  was  manually  placed  over  the  target  for  image  245  only. 

Figure  2-2  shows  the  gray  levels  of  the  target  and  its  immediate  background 
for  image  245.  The  gray  levels  are  coded  such  that  numbers  with  a  dash 
through  them  are  in  the  twenties;  numbers  without  a  dash  are  in  the  teens,  For 
example,  the  lower  row  is  §  which  means  26;  the  numbers  in  the  center  of  the 
window,  representing  the  target  are  2,  1,  3,  etc.  which  are  12,  11,  13,  and 
so  on.  Figure  2-3  shows  the  inner  window.  In  the  next  series  of  figures,  the 
baseline  tracker  results  appear  in  the  left  or  "a"  figure.  The  bandpass 
tracker  results  appear  on  the  right.  Figures  2-4a  and  2-4b  show  the  reference 
images  for  the  baseline  tracker  and  the  bandpass  tracker  for  a  threshold  t  <  20 
for  image  245. 

Figures  2-5a  and  2 - 5b  shows  the  tracked  images  245  using  the  same 
image  (245)  as  a  reference.  The  calculations  beneath  the  binary  image  are 
the  moment  computations.  Figures  2-6a  and  2-6b  show  the  tracked  target  for 
image  246  for  both  trackers.  Note  that  the  bandpass  tracker  presents  a  more 
compact  target;  the  same  situation  is  true  for  Figures  2-7a  and  2- 7b  (image  247) 
and  more  of  the  target  is  included  by  the  bandpass  tracker.  This  is  again  true 
and  to  a  greater  degree  in  Figures  2-9a  and  2-9b  (image  249).  Again  for  image 
250,  the  addition  of  the  lower  right  hand  tail  in  Figure  2-10a  would  adversely 
affect  the  aimpoint  computations. 
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Figure  2-2.  Target 
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Figure  2-4a.  Reference  Image 
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Figure  2-5a.  Tracked  Image  245 
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Figure  2-3.  Bandpass, 
Inner  Window 
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Figure  2-4b.  Reference  Image,  t<20 
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Figure  2-6 a.  Tracked  Image  246 


Figure  2-6b.  Bandpass  Tracked  Image  246 
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Figure  2~7a.  Tracked 
image  247 


Figure  2-7b.  Bandpass 
Tracked  Image  247 
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Figure  2-8a.  Tracked 
Image  248 


Fiqure  2-8b.  Bandpass 
Tracked  Image  248 
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Fiqure  2-9a.  Tracked 
Image  249 


Figure  2-9b.  Bandpass 
Tracked  Image  249 
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Figure  2-10a.  Tracked 
Image  250 
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Figure  2-10b.  Bandpass 
tracked  Image  250 
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Fiqure  2-lla.  Tracked 
Image  251 


Fiqure  2-1  lb.  Bandpass 
Tracked  Image  251 
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In  conclusion,  this  set  of  data  tends  to  indicate  that  the  bandpass 
binary  correlation  tracker  presents  more  of  the  target  within  the  inner 
window  than  the  binary  correlation  tracker  without  a  bandpass.  Further,  the 
bandpass  binary  tracker  presents  a  more  compact  target  and  a  better 
likeness  to  the  actual  target.  This  not  only  improves  track  position, 
but  allows  a  more  accurate  aimpoint  selection  when  based  on  external 
shape.  A  secondary  conclusion  of  this  test  is  that  the  window  width  was 
small  with  regard  to  target  motion,  hence,  the  correlation  width  was  not 
large  enough,  and  not  all  the  target  appeared  in  the  window. 
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3.0  875  LINE  STORAGE  DEVICE 

In  May,  the  875  line  frame  snatching  device  completed  development  and 
was  brought  on  line  with  the  other  pieces  of  the  Westinghouse  Image  Processing 
Laboratory  Equipment  which  will  be  used  for  this  contract  and  were  described 
in  the  First  Quarterly  Report.  Figures  3.0-1  and  3.0-2  show  the  output  of  the 
875  line  frame  grabber  to  a  test  pattern  input.  Figures  3.0-3  and  3.0-4 
show  the  output  for  the  NV&E0L  data  base  input.  The  875  line  device  is 
capable  of  grabbing  a  125  pixel  by  125  pixel  window. 


09  5/17/79 


Figure  3.0-1  .  Test  Pattern  Input 


17  5/1 7/79 


Figure  3.0-2.  Test  Pattern  Input 
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This  allows  Westinghouse  to  analyze  875  line  video  tape  data  directly 
which  will  become  more  important  as  875  line  formats  are  used  more  and  more 
by  the  military.  Converting  875  line  data  to  525  line  data,  either  through 
direct  video  tape  machine  conversion  or  through  a  vidicon,  suffers 
degradation  visible  to  the  human  eye. 
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4.0  PRELIMINARY  RESULTS 

This  section  presents  seven  scenarios  from  the  NV&EOL  data  base  in  TV 
which  was  described  in  the  Second  Quarterly  Report.  These  scenarios  were 
analyzed  with  the  purpose  of  finding  methods  of  maintaining  track  and  predicting 
obscurations.  The  reacquisition  of  a  disappearing  target  which  reappears, 
partially  occluded,  at  a  substantially  closer  range  and  different  position 
is  included. 

4.1  Crossing  Target  No.  1 

This  set  of  images  shows  a  light  APC  being  crossed  by  a  dark  blob.  The 
blob  is  associated  with  the  sensor  (SIT)  such  as  a  burn  spot  and  is  not 
another  vehicle  in  the  field.  In  one  image,  the  blob  completely  covers  the 
APC  and  the  frame- to -frame  tracker  jumps  to  a  piece  of  background  which  has 
gray  levels  within  the  tracker  bandpass.  In  the  next  frame,  the  tracker 
jumps  to  another  piece  of  background,  also  with  the  appropriate  gray  levels. 

The  cuer  reacquires  the  target  as  it  emerges  from  the  obscuration  and  redirects 
the  tracker  to  the  target.  In  summary,  this  scenario  shows  the  inability  of 
the  frame- to- frame  tracker  to  handle  the  case  where  the  target  is  completely 
obscured  for  only  a  frame.  Further,  background  is  present  within  the  track 
window  and  is  at  the  same  gray  level  as  the  tracker  bandpass.  This  portion 
of  the  background  draws  the  tracker.  The  scenario  shows  that  the  cuer-tracker 
combination  is  capable  of  handling  such  a  case.  Consider  the  scenario  in  some 
detail. 

The  sensor  is  scanning  across  the  scene  much  faster  than  the  target 
movement.  The  blob  is  moving  toward  the  APC  and  there  is  negligible  movement 
of  the  target  against  the  background.  The  apparent  movement  of  the  blob  is 
from  right  to  left  and  diagonally  down,  as  indicated  by  the  dashed  arrows  in 
Figure  4.1-1. 


APC  No 


-o  ,0 


Dark  Spot 


APC  No.  2 


o' 


Figure  4.1-1.  Target  Geometry 

The  set  of  images,  287-302,  is  shown  in  Figures  4.1-2  through  4.1-17.  Image 
301,  Figure  4.1-16,  shows  the  APC  completely  obscured  by  the  dark  blob;  Image  302, 
Figure  4.1-17  shows  the  APC  (two  small  spots)  emerging  from  the  obscuration. 

As  an  example  of  the  interaction  between  cuer  and  tracker  before  the 
obscuration  occurs,  consider  the  cued  results  of  image  287  shown  in  Figure 
4.1-18.  Here  the  maximum  number  of  matches  between  perimeter  points  and  thinned 
edges  (See  First  Quarterly  for  a  description  of  this  segmentation  process) 
occurs  at  a  gray  level  threshold,  t  <  16.  The  APC  of  interest  is  shown  in  the 
lower  left  of  Figure  4.1-2.  The  segmented  APC  image  is  turned  over  to  the 
tracker  as  a  reference  image  as  shown  in  Figure  4.1-19  and  image  287  through 
291  are  tracked  as  shown  in  Figure  4.1-20  through  4.1-24.  The  tracking 
performance  is  satisfactory  although  the  track  window  should  have  been  slightly 
larger  to  account  for  the  sensor  movement,  particularly  evident  in  images  289 
and  290,  Figures  4.1-22  and  4.1-23.  The  cuer-tracker  performance  for  the  images 
through  299  is  satisfactory  and  similar  to  that  of  287-291,  and  need  not  be 
discussed  further.  We  resume  the  analysis  at  image  300,  just  before  the 
obscurati on. 

The  segmented  results  of  image  300  in  Figure  4.1-25.  Figure  4.1-26  shows 
the  segmented  APC  as  a  tracker  reference  image  and  Figure  4.1-27  shows  the 

segmented  APC  in  image  300  as  a  tracked  image.  Figures  4.1-28  and  4.1-29 
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Figure  4.1-5.  Image  290 
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Figure  4.1-6.  Image  291 
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Figure  4.1-7.  Image  292 
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Figure  4.1-14.  Image  299 


Figure  4.1-15.  Image  300 
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Figure  4.1-16.  Image  301 
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Figure  4.1-17.  Image  302 
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Figure  4.1-18.  Cuer  Output  for  Image  287 
(1  indicates  edae/nerimeter  match) 
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Figure  4.1-19.  Image  287, 
Tracker  Reference 
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Figure  4.1-23.  Image 
290 


Figure  4. 1-24.  Imaqe 
291 
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Figure  4.1-25.  Cuer-Outout,  Image  300 


Figure  4.2-26.  Tracker  Reference, 
Image  300 
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show  the  tracker  output  for  images  301  and  302;  the  circled  l's  correspond  to 
the  circles  in  Figures  4.1-16  and  4.1-17  bounded  by  the  symbol  O 
From  Figures  4.1-16  and  4.1-17,  we  see  that  neither  of  these  is  at  the 
appropriate  target  position.  Further,  in  Figure  4.1-17,  we  see  the  target 
(2  small  spots)  emerging  from  the  obscuration.  To  repeat  in  more  detail, 
the  reference  tracker  image  for  image  300  is  shown  in  Figure  4.1-26  and  the 
tracker  output  for  image  300  is  shown  in  Figure  4.1-27.  At  image  300,  from 
Figure  4.1-26,  the  frame- to- frame  tracker  is  solidly  on  the  target.  Referring 
to  Figure  4.1-28,  Image  301,  we  see  that  the  dark  spot  is  solidly  covering 
the  target.  Since  the  bandpass  correlation  tracker,  described  in  Section  2.0  of 
this  report,  is  being  used,  it  jumps  to  the  upper  left  of  the  obscuration  where 
it  can  find  gray  levels  in  the  bandpass.  This  false  target  is  shown  circled 
on  Figure  4.1-28.  In  Figure  4.1-29  image  302,  the  tracker  then  jumps  to  the 
bottom  of  the  track  window  and  grabs  the  circled  false  target.  The  real  target 
is  shown  emerging  to  the  left  of  the  dark  obscuration.  So  the  binary  correlation 
tracker  has  broken  track;  let  us  now  consider  several  approaches  to  restoring 
track. 

We  discuss  several  approaches  for  restoring  track  in  terms  of  images  287- 
292,  Figures  4.1-2  through  4.1-17.  This  is  the  same,  relatively  simple,  set 
we  used  to  describe  the  interaction  between  cuer  and  frame-to-frame  tracker. 

We  shall  then  apply  the  track  restoring  approaches  to  images  300  and  beyond 
where  the  obscuration  occurs. 

The  geometry  of  the  first  series  of  images  are  shown  in  Figures  4.1-2 

through  4.1-17,  imaqes  287  through  302.  Image  287  is  segmented  for  a  best  match 

on  the  target  as  shown  in  Figure  4.1-18.  The  histograms  of  the  target, 

first  sector  ahead  of  the  target,  second  sector  ahead  of  the  target,  and  the 

sector  behind  the  target  and  the  number  of  edge/perimeter  match  points  on  the 

target  at  less  than  or  equal  to  the  threshold  are  shown  in  Figure  4.1-30.  Here 

it  is  seen  that  the  target  is  moving  into  a  darker  background  with  no  gray 

-26- 


HISTOGRAMS 


Threshold 

Target 

Matches 

Target 

First  Sector 
Ahead  of 
Target 

Second  Sector 
Ahead  of 
Target 

Sector  Behind 
Target 

14 

10 

12 

15 

10 

O 

(_ 

16 

17 

8 

17 

25 

12 

18 

25 

3 

2 

19 

6 

3 

20 

8 

16 

21 

5 

20 

22 

10 

11 

23 

14 

4 

24 

4 

19 

25 

4 

25 

Figure  4.1-30.  Matches  and  Histograms 
for  Image  287. 
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Figure  4.1-27.  Tracker  Output, 
Image  300 


Figure  4.1-28.  Tracker 
Output,  Image  301 


Figure  4.1-29.  Tracker  Output, 
Image  302 
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levels  equal  to  those  of  the  target.  The  background  is  segmented  from  the  darkest 
level  to  the  lightest  for  the  change  detection  reference  image;  the  threshold 
selected  must  be  more  than  the  target  highest  gray  level  to  exclude  the  target  from 
the  background  (Fiq.  4.1-31).  The  direct  segmentation  of  Fiqure  4.1-18,  from  low  to 
high,  is  used  to  set  the  reference  image  for  the  tracker  as  shown  in  Figure  4.1-19 
and  the  frame- to- frame  track  results  are  shown  in  Figures  4.1-20  through  4.1-24 
for  images  287  through  291.  The  change  detection  results  of  image  287  versus 
292  are  shown  in  Figure  4.1-32.  The  direct  segmentation  of  image  292  is  shown 
in  Figure  4.1-33.  Since  there  were  no  similar  gray  levels  in  the  sectors 
ahead  of  the  target  in  image  287,  the  direct  segmentation  is  preferred  and  the 
blob  found  is  used  as  the  reference  image  for  the  tracker  and  image  292.  This 
then  describes  a  complete  cycle  and  the  interaction  between  the  cuer,  target 
signature  prediction,  change  detector,  and  frame- to- frame  tracker.  With  this 
in  mind,  we  jump  to  image  300,  Figure  4.1-15  and  consider  the  remaining  images. 

For  image  300,  the  cuer  obtains  a  direct  segmentation  of  the  target  APC 
as  shown  in  Figure  4.1-34.  The  histograms  of  the  target  and  surrounding  sectors 
are  shown  in  Figure  4.1-35.  The  sector  ahead  is  seen  as  substantially  darker 
than  the  target,  hence,  it  is  very  possible  that  a  direct  segmentation  of  the 
target  will  produce  maximum  matches  at  a  higher  threshold  than  previously 
obtained.  However,  there  are  no  gray  levels  ahead  which  are  equal  to  those 
of  the  target  which  means  that  the  target  will  remain  segmentable  unless  it 
becomes  obscured  by  the  new  background  (e.g.  passing  into  a  woods).  In  any 
event  the  direct  segmentation  of  the  target  in  image  300  produces  the  reference 
track  window  shown  in  Figure  4.1-27.  From  images  301  and  302,  due  to  obstruc¬ 
tion  of  the  target  by  the  burn  spot.  Figures  4.1-28,  29,  the  frame- to- frame 
tracker  has  broken  lock.  A  direct  segmentation  of  image  303  (Fig.  4.1-36)  shows 
the  target  about  where  expected  and  at  a  darker  gray  level,  also,  as  expected.  So 
even  though  the  frame- to- frame  tracker  has  lost  the  target,  direct  segmentation 
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Figure  4.1-31.  Image  287 
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Figure  4.1-33.  Image  292,  Direct  Segmentation 
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Figure  4.1-35.  Histogram  of  Sectors  and  Target 
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Figure  4.1-36.  Image  303,  T  <  19 
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retains  the  target.  Let  us  examine  the  change  detection  results  to  see  if 
they  are  applicable  in  this  case. 

For  change  detection,  we  compare  the  background  of  image  303  thresholded 
at  t  >  20  with  the  background  of  image  300  thresholded  at  t  >  19.  Image  303  is 
shown  in  Figure  4.1-37  and  image  300  is  shown  in  Figure  4.1-38.  The  change 
detection  results  are  superimposed  on  image  303,  Figure  4.1-37.  At  first  glance 
the  change  record  seems  unintell igible.  However,  note  that  the  change  record 
in  the  lower,  center  part  of  Figure  4.1-37  has  a  dark  and  light  portion; 
both  portions  are  new.  They  are  new  in  the  sense  that  they  did  not  appear  in 
image  300.  We  are  looking  for  a  light  target,  and  there  is  a  light  part  of 
the  change  record  in  the  anticipated  target  position.  Hnece,  knowing  what  to 
look  for  (approximate  target  location,  polarity)  in  the  change  record  is  a 
significant  advantage.  Figure  4.1-36  shows  a  direct  segmentation  on  the 
target  for  image  303  and  confirms  the  change  record. 
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Figure  4.1-38.  Image  300 


4.2  ROAD  CROSSING  CASE 


In  this  example,  an  APC  is  moving  onto  a  road  from  a  field,  as  shown  in 
Figure  4.2-1.  The  gray  levels  across  the  APC  are  in  the  range  10-14  while  it 
is  in  the  field.  The  road  is  at  gray  scale  0,  and  the  surrounding  field  is  in 


Figure  4.2-1.  Road  Crossing 


the  15-20  range.  As  long  as  the  APC  is  in  the  field,  the  target  segmentation  is 
clean  as  shown  in  Figure  4.2-2  for  a  threshold  of  12.  The  statistics  for  each 
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Figure  4.2-2.  Road  Crossing,  Edge-Perimeter  Match  (+),  t<_12 

(Image  290) 


blob  are  shown  in  Figure  4.2-3.  Blob  number  2  is  the  target  and  blob  number 
1  is  the  road.  For  Blob  number  1,  the  average  gray  level  is  2.63;  the  x,  y 
coordinates  at  the  top  are  81,23;  the  x,  y  coordinates  at  the  bottom  are  80,43; 
and  the  xy  position  of  the  centroid  is  76.03,  32.43.  This  set  of  statistics 
gives  no  indication  of  any  impending  interference  with  the  target,  other  than  the 
fact  that  the  target  will  intersect  with  the  road  because  BOTY^  <B0TYj,  and 
TOPY2  >  TCPj.  However,  if  we  band  threshold  the  image,  i.e.  find  the  gray  scale 


,ar 


RRf-Cfc  rsfp  r  n  i  n  r  array 


niiHinmnin.... 
1 1 1  u  i  1 1  i  i  i  i  u  ii  i . . . . 
.  i  i  i  i  u  i  i  i  n  1 1  n  n  l .. 

.tuuillllllllllll,. 
.  .11  1  1  1 11  1  1  U  1  t  t  1  t  1  t  . 

...nuiitminni,. 

. uiiniiutnni 

. t  i  u  i  m  i  i  n  f  1 1 . 


. .  ,??? . nniinnniii 

e?ppp.?p . iiummui. 

rPrPPPP . 1  1  1  It  1  1  1  1  1  11  11 

C????. . 1111111111111. 

....'. . . . 1  1  11  1  1  1  1  1  11  1  1 

. .  11  1  1  M  1  1  1  11  H  . 

. 1 1 1 1 1 1 1 1 1 11 1 1 . 

. 111111111111.. 

. 1111111111111.. 


....  1 1 1 1 1 1 11 1 1 1 1 1 
.. 1 1 1 1 1 1 1 1 1 1 1 1 11 . 
.111111111111111. 
minimum.. 


BLGR  STATISTICS 

BLOR  AVG  TOP X  TOPy  RUTX  BOTY  XBa»  YP.AP 

1.  1  2.fe3  Pi  Pi  RO  43  76.03  32.43 

2.  ?  11, OR  SR  31  57  34  55,91  32.64 


BLOB  IDENTIFICATIONS 

matches 


Figure  4.2-3.  Blob  or  Segment  Statistics 
(Image  290) 

range  of  the  segmented  target  and  then  threshold  the  image  at  that  band,  we 
find  a  source  of  obscuration  as  shown  in  Figure  4.2-4.  Here,  blobs  numbers  1 
and  2  representing  the  shoulders  of  the  road  are  also  shown  in  Figure  4.2-4. 
This  figure  indicates  that  a  clean,  compact  target  segmentation  cannot  be 
obtained  when  the  target  is  on  the  shoulder,  and  the  classification  logic  will 
be  defeated.  Further,  there  is  the  possibility  that  the  frame- to- frame  tracker 
will  "hang-up"  on  the  shoulder.  The  band  threshold  has  several  drawbacks  in 
that  it  is  not  backed-up  by  an  edge  coincidence  and  the  band  is  not  constant. 
That  is,  the  gray  scale  of  the  target  will  fluctuate  as  seen  in  figures  4.2-5 
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Figure  4.2-4.  Image  Threshold  at  Gray  Level  Band  of  Target. 


through  Figure  4.2-10.  A  constant  band  of  10-14  would  have  caused  holes  in  the 
target  for  images  310,  410,  and  470.  The  lack  of  clean,  compact  segmentation 
is  seen  in  Figure  4.2- 10.  More  specifically,  the  cuer  cannot  give  the  frame- 
to-frame  tracker  a  clean  image  for  a  reference.  At  this  point,  we  have 
described  two  problems:  1)  predicting  obscuration,  and  2)  segmenting  in  the 
presence  of  obscuration.  Further,  can  we  estimate  the  distance  between  the 
target  and  the  impending  obscuration? 
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Figure  4.2-5.  Image  290,  Target  and  Road 
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Figure  4.2-6.  Image  300,  Target  and  Road 
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Figure  4.2-7.  Image  310,  Target  and  Road 
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Figure  4.2-9.  Image  470,  Target  and  Road 
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Figure  4.2-10.  Image  480,  Target  and  Road 
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The  band  threshold  approach  gives  only  an  approximate  measure  of  the 
distance  between  the  target  and  the  obscuration.  Referring  to  Figures  4.2-11 
thru  4.2-15  representing  images  300,  310,  410,  470,  and  480  the  measured 
and  calculated  distances  are  shown  in  Table  1. 
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Figure  4.2-11.  Image  300,  Banded  with  Statistics 
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Table  4.2-1.  Distance  to  Obscuration 


XBAR 

XBAR 

CALCULATED 

DISTANCE 

IMAGE 

TARGET 

OBSCURATION 

DXBAR 

(MEASURED) 

300 

94.04 

107.33 

13.29 

9 

310 

98.46 

111.80 

13.24 

9 

410 

13.84 

27.42 

13.58 

7 

470 

54.28 

63.77 

9.49 

3 

480 

92.01 

92.01 

0 

2 

We  compute  a  probable  intersection  of  objects  3  and  1  by  noting  that 
T0PY1  <  T0PY3  and  B0TY1  >  B0TY3.  Figures  4.2-12,  4.2-13,  and  4.2-14  show 
the  bands  for  images  310,  410,  and  470.  These  images  show  that  an  (inter¬ 
section)  obscuration  is  imminent.  However,  the  XBAR  statistic  does  not 
give  a  true  indication  of  the  "distance  to  obscuration."  For  example.  Table 

4.2- 1  shows  the  distance  to  obscuration  in  terms  of  XBAR  and  actual  distance. 

The  actual  distance  is  measured  by  counting  the  pixels  between  the  right  edge 
of  the  road  target  and  left  edge  of  the  road  border.  The  precise  number 

of  pixels  to  obscuration  may  or  may  not  be  needed.  This  depends  to  some  extent 
on  hardware  implementation.  It  is  enough  to  know  at  this  point  that  the 
prediction  of  obscuration  may  be  off  in  the  distance  by  the  centroid 
approach  by  60  percent  of  the  target  width.  In  Figure  4.2-15,  image  480, 
we  see  the  case  where  obscuration  of  the  target  front  end  has  occurred. 

Another  approach  to  the  obscuration  prediction  and  distance  to  obscuration 
problem  is  the  use  of  histograms  to  detect  regions  ahead  of  the  target  which  have 
the  same  gray  levels  as  the  target.  In  image  470,  Fiqure  4.2-9,  histograms  one 
and  two  target  widths  (mutually  exclusive)  in  front  of  the  target  and  one  target 
height  are  shown  in  Figure  4.2-16  as  well  as  a  histogram  of  the  target.  Figure 

4.2- 16  shows  that  the  background  one  target  width  in  front  of  the  target  will 
have  gray  levels  the  same  as  the  target.  However,  for  two  target  widths  in 
front,  the  background  will  be  different  again.  It  is  also  different  from  the 


I 

j 


background  one  target  width  in  front.  Both  the  band  threshold  and  histogram 
approaches  predict  obscurations  which  fall  in  the  same  gray  scale  range  as 


of  the 

target.  We  now 

address  segmentation 
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Figure  4.2-16.  Histograms  of  Background  and  Target;  Image  470 

Since  a  clean  segmentation  does  not  seem  possible  with  the  present 
segmentation  algorithms  we  are  faced  with  changing  them  or  retaining  enough  of 
the  target  to  maintain  a  coherent  track.  We  shall  try  the  latter.  Heuristically 
consider  what  happens  as  the  target  approaches  the  road  shoulder.  The  front  of 
the  target  merges  with  the  shoulder,  while  the  rear  is  clearly  visible  against 
the  darker  background  of  the  field.  Further,  as  the  target  moves  onto  the  road, 
the  target  gray  scale  becomes  lighter  as  shown  in  Figure  4.2-17,  image  590. 
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Figure  4.2-17.  Image  590,  Target  and  Road 


This  prevents  using  fixed  thresholds  across  the  transition.  As  the  target 
moves  further  onto  the  road,  the  target  rear  merges  with  the  shoulder  and 
the  front  of  the  target  becomes  more  apparent  against  the  road.  One  possible 
approach  is  to  sense  the  onset  of  the  new  background,  actually  two  backgrounds 
in  this  case,  and  obtain  a  segmentation  of  the  new  background  using  edae 
coincidence.  We  recognize  the  fact  that  we  shall  lose  the  front  of  the  target, 
but  the  rear  is  retained.  Hence,  the  frame- to-frame  tracker  can  be  directed 
to  it.  Once  the  target  emerges  onto  the  road  the  frame- to- frame  tracker 
will  be  directed  to  the  front.  This  is  shown  in  Figures  4.2-18  and  4.2-19. 


Tracked 


Fiqure  4.2-18.  Direct 
Tracker  to  Rear  of  Target 


Figure  4.2-19.  Direct  Tracker 
to  Front  of  Target. 
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Since  the  target  will  appear  on  the  road,  as  a  dark  target  against  a  light  back¬ 
ground,  we  threshold  down  from  the  target  and,  obtain,  as  shown  in  Figure  4.2-20, 
the  background.  Registration  and  subtraction  of  Figure  4.2-20  with  Figures 
4.2-18  and  4.2-19  obtains  the  rear  shape,  Q  ,  and  the  front  shape,  D. 
respecti vely .  The  tracker  reference  window  is  then  offset  so  that  this  portion 
of  the  target  is  placed  squarely  in  the  center  of  the  window.  Consider  now 
some  aspects  of  the  change  detection  process. 


Figure  4.2-20.  Background 

A  first  approach  is  binary  correlation  using  the  Exclusive  -  OR  function. 
The  single  biggest  problem  in  these  examples  is  the  choice  of  thresholds  for 
the  binary  correlation.  We  have  discovered  that  the  gray  scale  of  the  target 
changes  as  it  moves  from  one  background  to  the  next;  this  means  that  tryinq 
to  limit  the  thresholds,  band  them,  or  fix  them  ahead  of  time  is  not  appropriate. 
Secondly,  when  we  segment  the  background  (the  road  in  this  case),  the  segment¬ 
ation  may  include  part  of  the  road  shoulder  which  has  gray  levels  which  merge 
with  those  of  the  target. 

The  histogram  approach  allows  us  to  detect  the  obscuration  regions  (road 
shoulders)  within  the  general  background  (road,  in  this  case).  Secondly, 
the  histogram  approach  indicates  the  changing  target/background  polarities. 

For  example,  the  histogram  shows  a  gray  target  against  a  dark  background  for  the 
target  in  the  field.  This  histogram  shows  a  gray  target  against  a  light  back¬ 
ground  for  the  target  on  the  road.  The  anticipated  polarities  define  the 
threshold  levels  for  binary  change  detection.  For  example,  the  threshold  would 
be  everything  darker  (above)  than  the  target  for  the  field  background,  and 
everything  lighter  (below)  than  the  target  for  the  road  case.  This  approach 
assumes  that  the  target  outline  against  the  road  will  produce  strong  enough 


-51- 


edges  such  that  target  outline  is  represented  by  a  'hole"  in  the  road.  Havinq 
discussed  the  rationale  and  alluding  to  some  of  the  problems  we  found  in  other 
approaches,  we  now  move  into  the  mechanics  of  the  process. 

The  histogram  of  Figure  4.2-17  represents  image  470  and  is  the  last  image 
obtained  before  the  target  moves  on  the  road  shoulder.  Figure  4.2-21  shows 
the  number  of  matches  for  various  thresholds  starting  at  low  gray  levels 
(light)  and  moving  higher  (darker).  The  maximum  number  of  matches  occurs  at 
a  threshold  <  12.  The  resulting  image  is  shown  in  Figure  4.2-22a  and  4.2-22b. 
The  next  image  of  concern  is  480.  The  tabulation  of  matches  is  shown  in 
Figure  4.2-23. 
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Figure  4.2-21.  Tabulation  of  Matches,  Image  470 
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Figure  4.2-22a.  Image  470  and  Statistics 
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Figure  4. 2- 22b.  Image  470  and  Matches 
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Figure  4.2-23.  Match  Tabulation  for  Image  480 

Then  the  change  detected  image  is  composed  of  image  470  thresholded 
at  12  and  image  480  thresholded  at  12.  The  resultant  image  is  shown  in 
Figure  4.2-24.  The  left  portion  of  the  remainder  is  positioned  in  the  inner 

track  window,  which  is  just  large  enough  to  include  90  percent  of  the  target. 
The  next  change  detection  is  done  for  images  470  and  590,  i.e.  we  are 

trying  now  to  capture  the  front  of  the  target  and  place  the  frame  to  frame 
tracker  there.  Figure  4.2-25  is  a  tabulation  of  the  matches  for  image  590. 
The  appropriate  threshold  here  is  10  and  the  change  detection  result  is 
shown  in  Figure  4.2-26. 
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Figure  4.2-25.  Match  Tabulation  for  590 


In  summary,  we  have  described  the  mechanics  of  predicting  an 
obscuration,  estimating  how  the  target  signature  will  be  affected,  and 
moving  the  tracker  to  work  around  the  obscuration. 
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Figure  4.2-26.  Change  Detection  Result 
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4.3  DISAPPEARING  TARGET  NO.  1 

In  this  sequence,  an  APC  is  moving  through  a  woods.  The  APC  starts  as  a 
7  line  high  target  and  becomes  progressively  smaller  until  it  disappears  among 
some  trees.  The  range  from  the  helicopter  to  the  target  appears  to  be 
closing.  The  purpose  of  analyzing  this  sequence  is  to  discover  those  factors 
which  can  quantitatively  anticipate  and  confirm  a  disappearance.  Recognition 
of  these  factors  will  prevent  the  intelligent  tracker  from  becoming  "locked 
up"  on  a  section  of  background  which  is  left  after  the  target  is  gone.  Further, 
it  allows  the  intelligent  tracker  to  go  into  an  reacquisi tion  mode  which  is 
not  the  same  as  the  acquisition  mode.  That  is,  since  the  approximate  location 
of  the  target  is  known,  change  detection  can  be  employed  in  this  area  which 
is  less  than  the  entire  image,  thus  easing  the  hardware  burden.  It  also 
means  that  it  may  be  possible  to  reacquire  the  target,  through  change  detection, 
without  the  need  for  seeing  the  entire  target  shape. 

~he  sequence  of  images  runs  from  598  through  667.  For  imaqes  598 

through  638,  every  tenth  image  is  segmented  by  the  segmentation  techniques 

described  in  Appendix  A  of  the  rirst  Quarterly  Report.  From  image  641  to 

completion,  every  fifth  window  is  segmented  with  the  exception  of  image  646 

which  was  erroneously  deleted  during  some  computer  file  manipulations. 

Figures  4.3-1,  2,  3,  4,  and  5  show  the  target  in  images  598,  608,  618,  628, 

and  638  as  it  disappears;  the  target  is  the  blob  on  the  left  and  the  blob  on 

the  right  corresponds  to  a  small  clearing  in  the  woods.  These  images 

represent  the  raw  gray  scale  divided  by  four  and  rounded  to  the  nearest  integer. 

This  presentation  allows  the  analyst  to  quickly  see  the  more  important 

features  in  an  image.  It  is  assumed  that  the  intermediate  frames  (i.e. 

599,  600,  601,  602,  603,  604,  605,  606,  and  607  for  the  firsc  interval)  are 

processed  by  the  binary  correlation  tracker.  If  the  cuer  does  not  detect  the 

target  disappearance,  the  binary  tracker  will  continue  to  track  whatever 

reference  target  is  given  to  it.  That  is,  if  the  cuer  has  transferred  its 
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Figure  4.3-1.  Image  598 
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Figure  4.3-2.  Image  608 
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Figure  4.3-9.  Image  CG2 
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Figure  4.3-10.  Image  Gf>7 
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attention  from  the  target  to  the  background,  the  binary  tracker  will  track  the 
appropriate  portion  of  the  background.  The  remainder  of  the  cued  images  in  this 
sequence  are  shown  in  Figures  4.3-6,  ...  10.  One  might  argue  that  the  target  is 
still  present  as  seen  in  Figure  4.3-10,  but  the  video  tapes  show  the  target 
disappearing  in  the  same  vicinity  as  already  shown  in  Figure  4.3-6  (Image  241) 
and  reappearing  in  another  portion  of  the  image.  As  can  be  seen  in  Figure  4.3-10, 
the  target  area  has  merged  into  that  of  the  background.  We  have  shown,  in  all 
these  images,  a  clearing  in  the  woods  ahead  of  the  point  of  disappearance  wnich 
offers  a  source  of  trouble  to  a  tracker  which  opens  the  track  windows  if  and 
when  it  realizes  that  a  loss  had  occurred.  In  this  regard,  several  tracker 
experiments  were  conducted  on  this  sequence  which  are  described  later  in  the 
Section  (4.3).  Consider  now  the  problem  of  detecting  a  disappearance. 

One  might  suggest  that  the  intelligent  tracker  simply  wait  until  the  classi¬ 
fication  logic  cannot  classify  the  object  and  then  move  to  a  reacquisition  mode. 
There  are  two  reasons  why  this  is  probably  not  the  best  strategy.  First, 
performance  tests  on  existing  cueing  logic  for  classification  indicates  that 
there  is  room  for  improvement  in  both  correct  classifications  and  false  alarm 
reduction.  Second,  in  dense  clutter  such  as  exemplified  by  this  sequence,  the 
target  may  not  reaopear  as  unobscured.  That  is,  it  may  reappear  partially 
obscured.  This  condition  implies  an  acquisition  on  a  partially  obscured  target. 

To  avoid  this  prospect,  we  can  change  detect  on  the  background  in  the  vicinity 
of  the  target  disappearance  to  reacquire  the  target.  The  sensitive  issue  is  the 
appropriate  image  of  the  background.  If  the  target  disappearance  is  not  prompt¬ 
ly  detected  and  the  target  reappears  as  partially  obscured  but  cannot  be  cued 
directly,  it  will  be  taken  to  be  oart  of  the  background  provided  it  does  not 
move.  On  the  other  hand,  a  ornnpt  detection  of  disappearance  will  allow  the 
change  detection  algorithms  to  use  a  reference  background  in  which  the  target 
has  not  reappeared  thus  allowing  reaegui si tion  of  a  reappearing,  but  partially 
obscured  target.  This  case  is  considered  in  Section  a. 5.  Having  discussed  the 

rationale,  let  us  consider  the  mechanics  of  detectionq  a  disappearance. 
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The  idea  of  a  background  conposed  of  homogeneous  segments  has  been  considered 
by  several  workers.  Further,  some  of  these  efforts  and  others  have  been  devoted 
to  discriminating  between  targets  and  background  on  the  basis  of  histogram  proper¬ 
ties  which  rely  on  homogenity  properties.  For  example,  the  fourth  moment  of  a 
histogram,  kurtosis,  denotes  the  peakedness  of  a  histogram;  the  idea  is  that  a 
histogram  of  a  target  would  have  a  higher  kurtosis  than  a  histogram  of  the  back¬ 
ground  (same  window  size)  assuming  the  target  is  large  enough  to  have  an  interim 
distribution  of  gray  levels  other  than  a  uniform  one.  Clearly,  a  one-line  high 
target  does  not,  but  a  7  or  8  line  high  target,  from  our  experience,  usually  has 
some  distribution.  We  compute  the  kurtosis  for  the  target  in  image  638  and  641, 
Figure  4.3-5  and  4.3-6,  respecti vely.  The  framework  for  the  calculation  is  that 
kurtosis,  is  three  for  a  normal  distribution  and  -vl.8  for  a  uniform  distri¬ 
bution.  Further  the  following  table  shows  values  for  uniform  distributions 
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Figure  4.3-11.  Kurtosis  vs.  Classes  for 
a  Uniform  Distribution 


with  various  numbers  of  classes.  For  image  638,  there  were  four  classes  and  the 
kurtosis  was  1.04;  in  image  641,  there  were  two  classes  and  the  kurtosis  was  1.01. 
The  expected  result  was  a  kurtosis  approaching  3.0  for  image  638.  But  in  trying 
to  apply  the  kurtosis  criterion,  we  noticed  another  possible  approach. 

As  we  suggested  earlier,  a  target  seven  lines  high  should  have  some  gray 
level  distribution.  To  this  end,  vie  computed  the  mean  gray  scale,  GS,  of  the  target 
and  compared  it  with  the  superslice  threshold,  T.  Further,  we  compared  this 
aqainst  the  background  histogram  in  the  first  sector  ahead  of  the  target.  The 
histogram  computations  were  the  histoqram  mode,  that  value  occurring  most  often,  and 
the  "second  mode",  that  value  occurring  the  second  most  frequently.  The  results 


V 


are  shown  in  Figure  4.3-12  and  4.3-13  for  the  images  shown  previously.  In  Figure 
4.3-12,  the  histogram  mode  is  circled  and  the  second  mode  is  enclosed  in  a  square. 
The  point  of  this  figure  is  that  in  the  vicinity  of  images  618  through  647,  the 
background  in  front  of  the  target  is  fairly  constant. 
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Figure  4.3-12.  Modes  of  Background  Histogram 
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Figure  4.3-13.  Threshold  vs.  Average  Target  Gray  Scale 


In  Figure  4.3-13,  the  superslice  threshold  is  increasing  which  could  be 

explained  by  the  background  histogram  becominq  darker.  The  average  gray  scale 

in  the  interior  of  the  target  is  shown  to  be  12.1  for  image  598;  this  means 

that  the  target  has  a  light  interior  and,  more  importantly,  a  gray  level 
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distribution  across  the  target  since  GS  <  T.  However,  G~S  begins  to  approach  T 
which  means  that  the  target  is  becoming  the  same  gray  level  throughout,  while 
the  background  in  front  of  the  target  is  relatively  constant.  This  condition 
is  reinforced  at  image  657  in  which  no  target  blob  can  be  segmented. 

Recall,  on  the  video  tape,  the  target  is  disappearing  into  a  dense  clump  of 
trees;  the  dense  trees  can  be  characterized  by  the  constancy  of  the  histogram 
in  front  of  the  target.  As  the  target  disappears,  the  remaining  target  portions 
are  enlarged  as  the  segmentor  picks  up  more  and  more  of  the  background. 

Another  approach  to  the  same  problem  produces  the  same  result  but 
perhaps  a  little  more  dramatically.  The  superslice  algorithm  for  the  case  of 
a  light  target  in  a  dark  background  slices  up  from  zero.  At  each  threshold, 
it  forms  a  slice  through  the  target  so  a  succession  of  slices  produces  a  set 
of  laminations  of  increasing  area.  Normally,  the  process  stops  when  a 
maximum  number  of  matches  is  reached.  We  have  been  working  with  the  idea  of 
stopping  sooner  and  tracking  a  bright  interior  portion  of  the  target.  For  the 
sentience  under  discussion  suppose  the  slicing  is  stopped,  for  purposes  of 
tracking,  (not  identification),  at  a  match  of  70  nercent,  (i.e.  when  70  nerrent 
of  the  perimeter  points  are  matched  with  corresponding  edges).  In  Fioure  '1.3-!-. 
we  show  the  slice  threshold  at  which  70  percent  of  the  matches  occurred.  The 
decided  shift  into  higher  thresholds  is  seen.  The  numbers  in  parenthesis  are 
the  target  areas  at  each  threshold.  Thus,  the  light  interior  is  vanishing  while 

the  target  interior  suddenly  jumps  in  size  and  decreases  in  intensity,  again 

signifying  that  the  bright  target  interior  has  vanished.  This  is  another 

indication  that  the  target  has  disappeared  in  total. 

As  a  side  issue,  the  70  percent  figure  was  a  byproduct  of  the  work 
on  a  smaller  gradient  operator  window  described  in  the  Second  Quarterlv.  It 
appears,  based  on  a  limited  number  of  samples,  that  the  70  percent  Fiaure 
ensures  that  a  blob  has  a  fair  representation  of  edges  for  each  of  the 
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Figure  4.3-14.  70%  Thresholds  and  Tarqet  Area 

In  this  section,  we  have  described  two  lines  of  analysis  for  determining 
the  disappearance  of  a  target,  (i.e.,  loss  of  interior  highlights  above  super¬ 
slice  thresholds,  and  loss  of  area  of  small  bright  interior  details),  there  is 
nothing  to  preclude  using  both  of  them  in  a  complementary  fashion.  In  addition 
to  this  work  on  the  sequence,  we  performed  several  small  tracking  experiments  on  it. 

In  the  first  tracking  experiment,  we  looked  at  image  598  which  had  a 
tarqet  histogram  ranging  over  9-12;  we  set  the  band  pass  binary  correlation 
tracker  at  9-16  using  only  image  598  as  a  reference  image.  The  tracker  lost 
the  target  at  image  614.  Secondly,  we  used  every  other  image  to  simulate  the 
case  where  the  tracker  was  multiplexed  between  two  targets.  Several  things 
occurred:  (1)  the  target  moved  out  of  the  bandpass,  and  (2)  the  8x8  inner 
window  was  too  small  to  handle  the  larger  target  movements.  When  the  cuer 
identified  the  target  on  frames  598,  608,  618,  628,  and  638  and  updated  the  band¬ 
pass  of  the  tracker,  track  was  maintained  throughout.  However,  the  binary 
tracker  showed  a  tendency  to  slip  to  the  rear  of  the  target  (Figures  4.3-15,  ...20) 
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indicating  that  the  inner  track  window  was  too  small.  It  should  be 
pointed  out  that  the  binary  tracker  was  again  given  only  every  other  window 
to  track  and  track  was  not  broken  with  every  tenth  image  referenced  for  it 
by  the  cuer.  The  conclusion  is  that  a  bandpass  binary  correlation  tracker  has 
limited  capability  in  a  highly  cluttered  background.  Continuous  tracking  is 
possible  with  a  relatively  simple  tracker  being  updated  by  a  cuer,  and  in  this 
situation  it  is  possible  to  share  a  tracker  between  two  targets. 
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Figure  4.3-15.  Reference 
Image  608 
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Figure  4.3-16.  Image  610 
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Image  618 
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In  summary,  we  were  not  able  to  use  the  kurtosis  computation  to  detect 
a  target  disappearance.  The  modes  of  a  histogram  of  the  background  did  not 
seem  to  add  much  insight  to  the  problem.  A  more  useful  computation  is  the 
comparison  of  the  Superslice  threshold  obtained  through  a  maximum  number  of 
edge-perimeter  point  matches  with  the  average  gray  scale  over  the  target.  The 
average  gray  scale  approached  the  Superslice  threshold  even  before  the  target 
disappeared  as  measured  by  the  Smart  Sensor  segmentation  processes. 
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4.4  CROSSING  TARGET  MO.  2 


This  is  a  second  example  of  a  dank  target  (simulated  by  a  burn  spot  on  the 
SIT  tube)  crossing  a  light  target.  One  could  envision  such  a  maneuver  where  a 
lower  priority  target  would  cross  a  higher  priority  target  in  an  attempt  to 
confuse  the  tracker.  We  are  using  this  scenario  to  confirm  applicable  portions 
of  the  system  concept  developed  in  Section  4.2.  The  sequence  of  images  runs 
from  images  245  through  259;  images  250  through  259  are  shown  in  Figures  4.4-1 
through  4.4-10. 
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Figure  4.4-1.  Image  250 
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Figure  4.4-8.  Image  257 


Figure  4.4-9.  Image  258 
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Figure  4.4-10.  Image  259 
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Images  245,  250,  and  255  are  segmented  by  the  cuer;  the  intermediate 
images  and  images  256-259  are  processed  by  the  tracker.  Again,  the  sensor 
is  scanning  across  the  scene,  but  this  time  the  scan  is  to  the  right  and 
up.  First,  we  examine  the  segmented  frames  245,  250,  and  255. 

There  are  three  targets  in  the  image  numbered  (1),  (2),  and  (3),  shown  in 
Figure  4.4-1.  Targets  (1)  and  (3)  are  sliced  at  19  for  a  maximum  number  of  edge/ 
border  matches  and  target  (2)  is  sliced  at  26  for  its  maximum  matches.  In  image 
245,  the  histogram  of  the  two  sectors  in  front  of  target  (1)  are  composed 
of  gray  levels  with  values  23-26  but  target  (2)  does  not  appear  in  either 
sector.  At  image  250,  target  (1)  is  sliced  at  18,  target  (3)  is  sliced  at  17, 
and  target  (2)  is  sliced  at  27.  Image  250,  Figure  4.4-1,  is  interesting 
because  a  group  of  very  dark  pixels  appears  in  the  histogram  sectors  around 
target  (1).  At  this  point  ,  we  know  that  target  (1)  may  be  obscured  by 
the  darker  region  and,  therefore,  have  to  be  sliced  at  a  higher  threshold 
in  the  next  image.  This  assumes  that  it  is  not  completely  obscured,  in 
the  next  cued  image.  Following  the  change  detection  rationale  of  Section  4.2, 
we  segment  the  background  at  a  threshold  such  that  the  background  left  is 
above  that  of  the  target  in  gray  scale.  This  is  done  because  we  have  a  light 
target  with  a  dark  background  in  the  immediate  vicinity.  Another  constraint 
on  the  background  threshold,  of  course,  is  that  it  obtain  a  maximum  numberof 
matches  on  the  background.  Figure  4.4-11  shows  slice  thresholds,  in  image 
250,  against  the  number  of  matches  for  target  (1)  and  the  background.  The 
background  is  thresholded  at  20,  and  the  results  are  shown  in  Figure  4.4-12. 

For  image  255,  the  maximum  number  of  matches  on  the  background  are  236.  again 
occuring  at  a  threshold  of  20;  the  result  is  shown  in  Figure  4.4-13. 
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Figure  4.4-11.  Slice  Thresholds  for  Target 
and  Background,  Image  250 


Superimposed  on  Figure  4.4-13  are  the  change  results  of  images  250  and  255.  i 

i 

In  interpreting  change  detection  results  correctly,  it  is  important  to  anticipate 
the  probable  outcome.  In  this  case,  we  anticipated  that  target  (1)  would  be  j 

obscured;  Figure  4.4-13  shows  this  because  half  of  the  hole  in  the  background  j 

i 

caused  by  target  (1)  is  gone.  Further  ,  we  know  that  this  portion  is  composed  j 

of  pixels  which  have  a  gray  level  20  or  higher-  not  characteristic  of  target  < 

(1)  but  rather  the  background.  The  left  portion  of  the  change  record  ,  L-shaped, 
is  composed  of  pixels  which  are  20;  this  is  conceivably  the  edge  of  target  (1).  j 
In  summary  anticipation  of  an  impending  darker  background  should  lead  to  j 

using  those  portions  of  the  change  detection  record  which  are  lighter  than  the  j 

background  and  in  the  vicinity  of  the  target.  j 
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BLOB  STATISTICS 

Blob  Avg  TOPX  TOPY  BOTX  BOTY  XBAR  YBAR 

1.  1  23.26  89  36  89  74  65.22  54.37 

BLOB  IDENTIFICATIONS 
Matches 
1.  1  250 

Figure  4.4-12.  Background  of  Image  250 
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BLOB  STATISTICS 
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Fiaure  4.4-13.  Background  of  Image  255 
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Figure  4.4-14.  Direct  Segmentation .  Image  255 
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Direct  sgmentation  of  image  255  leads  to  the  target  image  shown  in 
Figure  4.4-14.  In  this  case,  the  target  was  almost  stationary  and  was 
crossed  by  a  dark  object.  Change  detection  was  not  appropriate  because 
there  was  little  change  with  respect  to  the  background.  Since  the  target 
was  only  partially  obscured.  Figure  4.4-14  shows  the  unobscured  portion 
which  can  be  used  for  the  track  reference  window. 

In  conclusion,  change  detection  and  direct  segmentation  are  complementary 
processes  for  obscuration.  When  an  obscuration  is  imminent,  factors  such 
as  whether  or  not  the  target  is  moving,  target  position,  and  target  polarity 
with  respect  to  the  impending  obscuration  provide  same  heuristics  for 
predicting  and  interpreting  the  changes  in  target  signatures. 
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4.5  DISAPPEARING  TARGET  NO.  2 


r 

I 

I 
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This  is  the  second  example  of  a  target  completely  disappearing  into 
heavy  clutter  where  no  portions  of  it  are  visible  as  it  moves  through  the 
clutter.  The  purpose  of  analyzing  the  sequence  is  to  confirm  the  disappearance 
using  a  comparison  between  the  superslice  threshold  and  the  average  gray 
level  across  the  histogram  of  the  target.  Approximately  every  tenth  frame  is 
sampled  and  segemented.  The  results  are  shown  in  Figure  4.5-1  for  images 
303  through  351.  Note  that  the  average  gray  scale  GL  begins  to  approach 


IMAGE 
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Threshold,  T 

19 
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Figure  4.5-1.  Comparison  of  Superslice 
Threshold  vs.  Average  Gray  Level 


the  superslice  threshold,  T,  at  image  313  and  is  within  .5  of  T  at  image  323. 

A  difference  of  .5  in  the  orevious  example  indicated  a  target  loss.  Image 
331  offers  more  evidence  of  a  target  loss  which  is  confirmed  in  images  341 
and  351.  Figures  4.5-2,  3,  ...  7  show  images,  median  filtered,  303,  313,  323, 
331,  341,  and  351  respectively  for  the  target  and  a  small  region  around  it. 

In  conclusion,  it  appears  that  a  comparison  of  the  average  gray  level 
across  the  target,  GL,  with  the  superslice  threshold,  T,  can  be  used  in  detecting 
the  presence  or  absence  of  a  target. 
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Figure  4.5-2.  Image  303 


Figure  4.5-3.  Image  313 
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Figure  4.5-4.  Image  323 


Figure  4.5-5.  Image  331 
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Figure  4.5-5.  Image  341 


Figure  4.5-6.  Image  351 
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4.6  REAPPEARING  TARGET 

In  Sections  4.3  and  4.5  we  analyzed  disappearing  target  examples  and 
provided  several  technigues  for  the  prompt  discovery  of  a  disappearance.  It 
was  felt  that  prompt  discovery  will  give  the  cuer  an  advantage  by  obtaining  a 
reference  scene  without  the  target.  Then  some  form  of  change  detection  may  be 
employed  to  test  for  the  reapoearance  of  the  target.  Let  us  examine  this 
idea  by  describing  a  reacquisition  scenario. 

Assume  a  target  is  completely  lost  in  heavy  clutter,  i.e.  it  cannot  be 
seen  as  it  moves  through  the  clutter  and  away  from  the  point  of  di saopearance. 

This  means  that  the  target  could  move  in  any  direction  from  the  point  of  dis¬ 
appearance  and  subsequently  reappear  in  a  partially  occluded  condition.  Further, 
the  target  can  reappear  as  a  light  target  against  a  dark  background  or  vice  versa. 
In  particular,  the  target  could  reappear  at  the  edge  of  a  light  clearing  as  a 
slightly  darker,  partially  obscured  target.  The  problem  is  further  compounded 
by  allowing  the  sensor  platform  to  change  range  and  aspect  to  the  last  target 
position  between  di sappearance  and  reacquisition.  Consider  the  complications 
this  situation  creates  for  binary  change  detection  employed  in  earlier  examples. 

To  perform  binary  change  detection,  the  histogram  sectors  ahead  of  the 
target  are  employed  to  predict  whether  the  target  gray  levels  will  darken  or 
lighten  against  the  new  background.  Since  we  do  not  know  where  the  target  will 
reappear,  we  cannot  know  what  the  new  background  will  be.  Further,  as  the  range 
and  aspect  change  between  disappearance  and  reappearance,  certain  areas  of  the 
background  will  change  shape  and  gray  level.  Interpreting  these  changes 
becomes  more  difficult;  recall,  that  binary  change  detection  was  used  because 
the  parameters  of  changes  (i.e.  scale,  rotation,  aspect,  perspective,  S/N 
ratio)  were  small.  Here,  that  assumption  is  substantially  weakened. 


1 


We  approach  this  problem  by  performing  the  inverse  of  the 
disappearing  target  example.  That  is,  we  require  the  reappearing- target 
to  have  a  well-defined  (maximum)  edge/perimeter  match  as  found  by  superslice 
and  interior  highlights  as  defined  by  T-GS  >  .5.  We  anticipate  that 
some  background  objects  (clearings)  will  be  segmented  but  a  reappearance 
of  the  target  in  those  regions  will  be  detected  by  changes  in  the  T,  GS 
relation.  Hence,  we  need  only  perform  change  detection  over  those  areas 
which  can  be  segmented  by  superslice. 

We  start  the  process  just  described  at  image  641.  Figure  4.6-1  shows  t 
number  of  matches  at  each  threshold  for  a  particular  blob  in  image  641.  The 
permissable  gray  levels  are  those  less  than  or  equal  to  the  threshold,  T. 

The  table  entries  show  the  number  of  edge-perimeter  matches  at  each 
threshold.  The  circled  entries  indicate  where  two  blobs,  separate  at  a  lower 
threshold,  merge  at  a  higher  threshold.  There  are  three  significant  blobs  in 
the  image,  the  others  do  not  appear  to  affect  the  results.  These  are  shown 
in  Figure  4.6-2,  imaqe  641.  Blob  No.  7  is  the  disappearing  target  and  marks 
the  position  where  the  target  disappears,  Blob  No.  5  is  a  clearing  in  the  woods 
directly  in  the  path  of  the  disappearing  target,  and  Blob  No.  8  represents 
another  clearing  in  the  woods  where  the  target  reapoears.  The  remainder  of  the 
images  647-667  depict  essentially  the  same  scene  except  the  range  to  target  is 
■-  >..i  mutely  h.tl/ed  and  there  is  a  downward  displacement  of  approximately 
uu  pixels.  Figures  4.6-3,  4,  5,  and  6  represent  the  results  of  thresholding 
for  images  647-662.  In  general,  these  results  do  not  indicate  the  presence  of 
a  target.  More  specifically,  the  number  of  matches  do  not  reach  a  maximum  for 
the  blobs  in  the  series  of  images.  The  range  of  thresolds  explored  is  10-20. 
Figure  4.6-7  shows  the  threshold  series  for  Blob  5  and  8  only.  Blob  7  has  not 
segmented  as  a  target  since  the  time  that  the  target  disappeared  there.  The 
target  first  reappears  at  image  657  at  the  position  of  Blob  8,  however,  according 
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to  Figure  4.6-7,  there  is  no  target  detection.  That  is,  the  number  of  matches 
does  not  reach  a  maximum.  Starting  at  image  662,  there  is  a  detection  and  in 
images  666  and  667.  Note  the  circled  maxima.  There  is  a  false  detection  on 
Blob  5  at  image  657  which  is  not  repeated  in  the  later  images.  At  image  668, 
the  sensor  slews  and  moves  the  target  out  of  the  window  being  used  for  frame 
grabbinb,  so  image  667  represents  the  end  of  file.  For  images  662,  666,  and 
667,  we  compare  the  superslice  threshold  against  the  average  gray  level  over  the 
target  in  the  next  step  in  the  detectionprocess  in  Figure  4.6-8.  Hence,  the  second 
criterion  in  the  detection  process  is  met  for  Blob  8.  The  present  approach  has 
the  added  feature  that  it  is  a  by-Droduct  of  the  cueing  process  and  several  more 
fairly  simple  calculations  used  in  detecting  a  disappearing  target.  As  a  matter 
of  fact,  the  same  hardware  is  used  in  the  disappearing  and  reappearing  cases 
with  one  algorithm  being  the  inverse  of  the  other.  Recall,  that  in  the  disapoearing 
target  case  maxima  were  achieved  and  T-GL  was  used  to  detect  the  absence  of  a 
target.  It  should  be  noted  that  Blob  5,  the  clearing  in  the  extrapolated  path 
of  the  target  had  T-GL  >.5  at  several  of  the  intermediate  frames  between  641 
and  667,  but  achieved  a  maximum  in  edge-perimeter  match  only  on  one  image.  In 
other  words,  a  persistence  criterion  can  be  employed  to  strengthen  the  validity 
of  the  detection. 

Figures  4.6-9,  10,  11,  12,  13  shows  the  clearing  as  Blob  No.  8  for  images 
,  ■  '7,  *■'■? .  -f-6,  •.  J  -:'l  Note,  again,  that  the  target  reappears  at  image  657. 

In  reviewing  this  work  done  Oo'—i.-- .  \:V RECL ,  s jgqes 4 ed  a  conceptual  framework 
•  r  the  effort. 

From  the  above  discussion  it  should  be  obvious  that  none  of  the  simple 
target  signature  based  techniques  discussed  so  far  (e.g.  segmentation  and  pattern 
r-coqni tion,  frame-to-f rame  tracking,  local  area  change  detection)  nor  their 
■.  .'oerqistic  use  is  capable  of  providing  a  solution  to  t'.e  problem  of  the  re- 
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appearing  target.  The  difficulty  arises  from  the  very  close  interaction  of  the 
target  with  the  background  in  this  case.  In  previous  cases  (e.g.  crossing  object 
cases,  road  crossing  case)  this  problem  could  be  overcome  by  using  simple  change- 
detection  since  the  target/background  interaction  took  place  over  a  short  span 
in  both  space  and  time  -  which  allowed  us  to  avoid  a  detailed  analysis  of  the 
background  character  by  assuming  that  the  background  (whatever  it  was)  was  quasi¬ 
static.  In  the  reappearing  target  case,  the  target/background  interaction  takes 
place  over  longer  spans  in  both  time  and  space  and  quasi-static  assumptions  can¬ 
not  be  expected  to  apply. 

What  is  needed  is  a  rudimentary  theory  or  model  of  the  anticipated  charac¬ 
teristics  of  both  targets  and  backgrounds.  Fortunately,  the  work  to  date  suggests 
a  basis  for  such  a  mode.  We  have  noted  that  the  disappearance  of  a  target  is 
detectable  both  as  the  failure  of  superslice  to  find  it  (e.g.  inability  to  find 
a  maximization  of  edge/border  point  matches  with  threshold  variation)  and  by  the 
loss  of  interior  detail  in  the  target  just  prior  to  disappearance.  This  would 
suggest  the  following  basic  models. 

TARGET  MODEL:  Targets  are  man-made  objects.  As  objects  they  are  of  limited 
spatial  extent  and  are  composed  of  "blobs"  which  "move  together"  in 
time  and  space.  As  man-made  artifacts  they  are  surrounded  by  well- 
defined  edges/borders  and  contain  significant  interior  detail. 

BACKGROUND  MODEL:  Backgrounds  are  composed  of  objects  (man-made  and 

natural)  and  regions.  Objects  (e.g.  roads,  clearings)  are  of  limited 
spatial  extent  (in  at  least  one  direction)  and  tend  to  be  bounded  by 
well-defined  edges/borders.  They  do  not  change  over  reasonable  time 
spans.  Regions  are  areas  of  large  spatial  extent,  generally  relatively 
uniform  in  intensity  or  texture  and  often  having  poorly  defined  edges/ 
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Figure  4.6-1 
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Image  667 
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4.7  THREE  CROSSING  TARGETS 

This  scenario  was  described  in  Section  4.0  of  the  Second  Quarterly  Report. 
An  APC  is  crossing  between  two  other  APC's;  all  the  targets  are  light  and  the 
background  is  dark.  There  is  no  gray  level  differentiation  between  the  three 
targets  shown  in  Figure  4.7-1.  We  described  the  idea  of  tracking  the  bottom 


Figure  4.7-1.  APC  Passing  Between  Two  Other  APC's 

and  top  y  coordinates  of  all  three  targets  to  maintain  track.  Here,  in  an 
effort  to  have  a  single  algorithm  handling  signature  prediction  problems, 
we  apply  the  change  detection  technique  discussed  in  Section  4.2  (Road  Crossing 
Case)  of  this  report.  We  present  a  heuristic  analysis  of  this  approach. 

The  histogram,  moving  ahead  of  the  left-most  APC,  would  detect  the 
presence  of  similar  gray  levels  in  the  two  targets  on  the  right.  Recall,  there 
is  a  histogram  analysis  performed  on  the  background  just  ahead  of  the  target. 

The  position  of  the  histogram  is  derived  from  the  track  window  position  errors. 
We  perform  change  detection  by  segmenting  the  background  and,  in  the  process 
of  doing  this,  the  two  APC's  would  be  described  as  "holes"  thus  confirming  their 
approximate  positions.  Recall  also,  that  segmenting  a  dark  background  means 
we  are  slicing  downward  from  high  gray  levels.  When  the  targets  merge,  the 
image  looks  like  Figure  4.7-2.  That  is,  there  is  considerable  "bridging" 


Figure  4.7-2.  Merged  Targets 
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among  the  targets.  The  binary  change  detection  record,  thresholded  at  the 
maximum  number  of  matches  on  the  background,  between  Figures  4.7-1  and  4.7-2 
is  shown  in  Figure  4.7-3.  In  interpreting  Figure  4.7-3,  it  is  important  to 
understand  where  a  light  region  has  been  added  or  deleted.  The  cross-hatched 
area,  ,  means  that  the  area  is  dark  in  the  second  record;  the  area 

denoted  by  the  parallel  slanted  lines^^  ,  means  that  this  light  area  is 
present  in  the  second  record.  Hence,  the  target  of  interest  must  be  in  this 
new  light  area  somewhere.  The  first  image,  4.7-1,  is  now  replaced  in  memory 


Figure  4.7-3.  Change  Detection  Record 

by  the  second  image,  Figure  4.7-3.  The  final  image  appears  in  Figure  4.7-4  and 
is  the  mirror  reflection  of  Figure  4.7-1.  The  change  record  between  Figure  4.7-2 

o- 


Figure  4.7-4.  Completion  of  Crossing 

and  Figure  4.7-4  is  shown  in  Figure  4.7-5.  This  time  the  dark  region, 
is  between  the  two  stationary  targets.  And  the  new  light  region  in  the  second 
image  is  the  crossing  target,  which  has  now  passed  beyond  the  other  two. 
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Figure  4.7-5.  Change  Detection  Record 


In  conclusion,  the  same  approach  is  applied  to  both  the  Road  Crossing 
Case  and  the  Three  Crossing  Targets  Case.  Also,  in  both  cases,  the  tracker 
is  shifted  to  the  unobscured  rear  of  the  crossing  target  until  it  disappears 
and/or  the  front  portion  when  it  reappears. 
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